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ABSTRACT 
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and as a means of introducing system into an educational enterprise. 
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politi.cal tool, the promise made by accountability and whether the 
promise can be kept, difficult issues, who is accountable to whom, 
and resistances to accountability. System approaches to 
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goals and objectives, and second, developing systems for evaluations, 
feedback, and corrective action. Specific program approaches to 
accountability described are external performance contracting, 
internal performance contracting, the voucher system, external audit 
or EPA, systems analysis, and PPBS. The evaluation portion of 
educational accountability is presented as to what evaluative 
research is, who should do the evaluation, types of evaluation 
studies, evaluation procedures, research design and measurement, and 
technique used to analyze evaluation data. Five case studies are 
provided as illustrations of attempts to implement accountability 
systems. The programs described are the Portland Public Schools 
Performance Contracting, Portland, Oregon; Contract Leasing, Grand 
Rapids, Michigan; PSRMAC Program Audit, State of Washington; A System 
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PUTTING RESEARCH INTO EDUCATIONAL PRACTICE 



■ a synthesis and interpretation of research, deveiopment, and 
current practice on a specific educationai topic 

■ a method of getting significant R&D findings to the practi- 
tioner quickiy 

■ the best thinking of researchers interpreted by speciaiists in 
simpie ianguage 

■ the focus of research on current educationai probiems 

■ a format which can be easiiy and inexpensiveiy reproduced 
for wide distribution 

■ raw materiai in the pubiic domain which can be adapted to 
meet i oca i needs 

■ an attempt to improve our Nation's schoois through research 



Use of funds for printing this publication approved by the Director of the Office of 
Management and Budget July 27, 1970. 
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' Errata 



The diagram on page 9 of this 
publication is incomplete. This is 
how the .classical system diagram 
should look. 

The price of this issue is .60 
cents. 
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ACCOUNTABILITY: THE PHILOSOPHY 



Accountability is the subject of many mis- 
understandings. it is often misunderstood by 
teachers who view it as a whip or a "bum rap"; 
by school administrators who believe it will 
solve their problems; by parents who hope it 
wili enabie their children to bring home straight 
“A’s"; by private companies who feel it creates 
a specific, lucrative educational market for 
their services; and by government agencies who 
view it as a method to save funds. The .term 
accountability is a convenient catchail for the 
various charges the perennial critics of schools 
have leveled at educators. The word has also 
been used by its advocates to characterize 
almost every innovative educational technique 
or program. Definitions abound, but the authors 
have chosen to treat accountability as a philos- 
ophy and as a means of introducing system into 
an educational enterprise. The philosophy is 
one of responsibility; the schools are account- 
able for their product. System refers to closing 
the feedback ioop by honestly evaluating iearn- 
ing and making corrective changes on the basis 
of evaluation findings. 

The Demand for Accountability 

A number of social and political develop- 
ments have converged to produce widespread 
demands for accountability. Among, these are 
the growing public movement for evaluation 
and cost/ benefit analysis of resources ex- 
pended by the Federal Government, the in- 
crease of reports in the media of criticai assess- 
ments of educational programs and the war on 
poverty, which have focused public attention 
on the large numuers of children, especially 
the culturally disadvantaged minorities, who 
lack the basic skiiis of reading and arithmetic. 
While the failures of the schools are not new, 
they can no longer be hidden or ignored. 
Underlying the criticism there is something 
new: a new optimism that all children can 
succeed in schooi if the conditions are right. 
For the first time schoois are being asked to 
act as accountable agents who service all of 
their clientele. 

The older "competitive free market" model 
— in which the student, sink or swin, was solely 



responsible for his failure — is yielding to a 
new phiiosophy in which every student is ex- 
pected to succeed, and the school feels a 
responsibility to make that happen. Still, these 
are not the only forces placing new demands 
on the schools. Americans are in a mood for 
self-appraisal; many of the traditions, institu- 
tions, and basic goals of society are^ being 
questioned, and not just by "irresponsible" 
youth. As one of the institutions traditionally 
responsible for transmitting the culture, the 
schools have become a central battleground in 
the struggle of ideas and values. The discrep- 
ancy between what schools are professing to 
teach and what students are actually learning 
is increasingly obvious. Growing parental con- 
cern, the general unrest in society, the search 
for relevance, the failure of the schools to be 
parental surrogates, and the reevaluation of 
traditional goals have all been Instrumental In 
encouraging the movement for accountability. 

New educational technology has also had Its 
impact. The trend to define goals and objec- 
tives in performance terms can be traced 
to behaviorist psychologists such as Sidney 
Pressey, Ralph Tyler, and B. F. Skinner whose 
ideas about operant conditioning formed the 
basis of prografmed instruction. Programed in- 
struction is designed to ensure that 85-95 
percent of the students master each frame in 
a program; it was a short step from this fact 
to the formation of the idea of guaranteed 
student learning defined in terms of behavioral 
outcomes (objectives). The idea was further 
expanded by Benjamin Bloom and others to 
produce the mastery learning approach which 
assumes that the great majority of students 
can master a curriculum if given sufficient 
time and exposed to a variety of teaching 
techniques. The increasing invoivement of in- 
dustry in education introduced the concept of 
quality control, a philosophy that claims every 
child can succeed if conditions are closely 
identified and their high quality ensured by 
monitoring. For example, the concept of zero- 
reject production from industry has led to the 
idea of a zero-reject educational program which 
guarantees success in some terms for every 
child. In the process, emphasis has been 
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shifted from educational input (teacher char- 
acteristics, number of books, numbers and type 
of courses, amount of money spent, and 
space allocated) to output (measurable student 
learning). 

These philosophies have often been com- 
bined with techniques of systems analysis, 
which were first applied to government enter- 
prises in the Department of Defense under 
Robert McNamara, and subsequently to educa- 
tion in the form of management by objectives 
and PPBS (Program Planning and Budgeting 
Systems). The demands for accountability and 
for stringent evaluation as a precondition for 
receiving public and private grant monies are 
the logical requirements of a government that 
seeks to determine how efficiently public money 
is being spent. 

Public taxes have been rising steadily and 
taxpayers now feel they ought to determine 
priorities among the social services purchased 
by their tax dollars. Conservative taxpayers are 
reluctant to give the schools more money 
unless it can be demonstrated that they are 
getting measurable results. The minorities and 
their champions charge that the schools are 
not edr:cating their children. Julius-, Hoffman, 
director of the Washington Institution of Quality 
Education, has said, "Education is the only 
industry in which the consumer, the child, is 
held responsible for the quality of the product.” 

A Possible Political Tool 

There are angry political and ideological 
overtones in some of the taik about account- 
ability, and one of the great dangers is that, 
through misapplication of ..the accountability 
processes, the schools can become political 
tools in the hands of dissenting groups and the 
needs of students become subordinate to 
political issues. For instance, if various pres- 
'» sure groups demanded that the criterion of 
student performance in a school should be 
the learning of their "facts" and the points 
of view which they advocate, and if they suc- 
ceed in compelling the school to carry out 
these points of view in its programs, then the 
distinction between reform and abuse has been 
eliminated. 

A related caution concerns the imposition 
of standards by the funding agencies who col- 



lect public money and redistribute it to local 
school districts. There is the continual danger 
that some of these agencies will limit creativity 
and stereotype program approaches by setting 
down narrow and rigid guidelines. Not only 
does this reduce local initiative to discover 
solutions that meet local conditions, but it can 
also produce in educators a "ieveling down” 
to minimal achievement that just meets the 
standards set by the funding agency. 

But the most serious danger to the account- 
abiiity movement is the varied and contradictory 
interpretations of the idea of accountabiiity. 
In the hands of reformers and popularizers 
the concept loses all meaning. Accountability 
becomes a buzz word which stands for almost 
any educational practice they might wish to 
promote or attack. Extravagant claims and 
baseless accusations are eroding the credibility 
of accountability. Accountability is not a new 
rniracle diet; it is not a new gimmick that will 
cure all ills of the schools in a week or a 
month. Accountability is also not a purchasable 
item. One cannot hire a consuitant or company 
to come into a situation and do accountability, 
thereby resolving all the problems. Account- 
ability will not solve all or even most of the 
problems encountered in education today. 
Accountability will not even produce more 
learning for less cost. In the broadest sense of 
the word, accountability transcends any par- 
ticular program or technique; it is a philosophy 
and a way of introducing systematic organiza- 
tion and responsibility into educational e.nter- 
prises. It most certainly can help clarify and 
define educational problems and perhaps it 
can increase the motivation to solve them, but 
the solutions themselves remain as elusive 
and complex as ever. They remain educational 
solutions, the application of improved method- 
ology and more relevant learning experiences 
for children. In the face of the misinformation 
about accountability, it becomes critical for 
educators to understand that their basic prob- 
lems will still remain even after accountability 
processes have been instituted. 

Accountability Is Keeping ^ Promise 

Since the early 1950s, it has been recog- 
nized that nearly all students can succeed in 
learning if relevant content and a variety of 
teaching techniques are available, and if the 
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students are given enough time to iearn. it is 
no longer acceptable for students to graduate 
from high school with elementary reading skills. 
In every area of the curriculum minimum stand- 
ards are being significantly raised and at the 
same time serious expectations are entertained 
that sli students are to meet these standards, 
including the considerable proportion who were 
not making appreciable progress in the past. 
New instructional models are being developed 
in which students are no longer compared with 
each other; they are graded in terms of their 
own progress toward defined behavioral objec- 
tives on criterion-referenced tests. 

A new promise is being made to students 
and parents and the accountability movement 
seeks to hold educators responsible for that 
promise. 

Can the Promise of Accountability Be Kept? 

About seven million American students are 
in critical need of special instruction in read- 
ing. In the 1969-1970 school year there were 
approximately 800,000 dropouts from high 
school, an increase of 100,000 from the pre- 
vious year. Youth unemployment is directly 
related to dropout rates and presents .still 
another dismal problem. Jobs calling for high 
school graduates have increased 30 percent, 
while jobs for nongraduates have decreased 
25 percent. These problems are manifestations 
of serious disparities and conflicts within our 
society, and they should not be laid at the 
door of any one of our institutions alone. And 
so, before one can determine reasonable ex- 
pectations for the accountability movement, 
he must assess the degree to which better 
education can contribute to the solution of 
these problems. Certainly, a clarification of 
goals and responsibilities can introduce new 
vigor and health into our schools. And, perhaps, 
reform in education will spread and revitalize 
other segments of our society. These are 
imponderables; so one must look closely at the 
specific experiments in accountability to make 
an assessment of its effectiveness in bringing 
about educational change. 

The short-term prospects of accountability 
programs to achieve the promises made for 
them by advocates are not promising. Although 
the Office of Economic Opportunity has been 



interested in starting a voucher plan,' none of 
the schob'l districts considered as sites have 
been willing to implement the plan. Resistance 
to other approaches to accountability is also 
high. There has been much criticism by 
teachers and administrators of the California 
PPBS system. The recent evaluation studies 
made by Rand Corporation (1971)' of the per- 
formance contracts funded by the Office of 
Economic Opportunity found that performance 
contract attempts thus far have resulted in 
surprisingly small increases in students’ read- 
ing and math skills. It was noted that perform- 
ance contracting is most effective as a vehicle 
for implementing new and complicated teach- 
ing methods, since school personnel can bene- 
fit from inservice training and observation of 
the contracting company using the new tech- 
niques. Many educators now believe that 
accountability approaches in public schools 
will not be effective until teacher training 
institutions become accountable for teaching 
modern instructional methods and for intro- 
ducing teachers to modern materials. Adminis- 
trators must also be persuaded to support 
accountability, both their own as well as 
teachers'. 

Although student learning has not been sig- 
nificantly improved, many accountability pro- 
grams report that side effects have been 
positive. Students respond well to the added 
interest in their learning and welfare, and 
dropout rates and absences have decreased in 
some schools participating in performance con- 
tract plans. Teachers working in these experi- 
mental programs seek more effective teaching 
techniques and show greater concern for shw 
learners and culturally deprived students. 

In the long run, the accountability movement 
will be considered successful if it helps com- 
plete the current revolution in educational 
philosophy which says that every child can 
learn and that all who influence that learning 
accept responsibility to reach each individual 
student, to evaluate programs objectively, and 
to make the necessary changes indicated by 
evaluation results. The long-term success of 
accountability will also be measured by the 



‘ See pp. 18-19 for a discussion of voucher plans. 

’ PREP report 28 on "Educational Performance Con- 
tracting" was based upon one of the Rand studies. 



degiec to which it helps to spell out educa- 
tional alternatives and the relationship of re- 
sources to benefits, and to fix responsibility 
and provide means by which the best alterna- 
tives can be adopted. Accountability is not a 
panacea. Educators must not have unrealistic 
expectations, but they can move forward the 
promise of accountability. 

Some Difficult Issues 

Teachers are usually held "accountable” for 
keeping their classrooms quiet (although it 
has been demonstrated that this can be an 
impediment to learning), which illustrates that 
accountability deals with values. Goal decisions 
must define what students should learn, but 
goal development falls heir to all the same 
problems in which educational philosophers 
have eternally entangled themselves, because 
goals involve values. The only areas of fairly 
universal agreement on goals are those related 
to coping with life now, understanding laws, 
reading labels and newspapers, and computing 
tax forms, etc.. Heated conflict between educa- 
tional ideologies appears whenever goals touch 
upon the higher questions of what heaven we 
will be transported to after death. For example, 
there is an unresolvable dispute between the 
humanists, who believe that education must 
develop the inner individual, foster creativity, 
and teach the art of questioning, and those 
who seek education’s role as teaching the three 
R’s, as techpical and prevocational skill train- 
ing, and as indoctrination into the values and 
ethics of the culture. Such conflicts will not 
be resolved by accountability; they can only 
be clarified. Moreover, conflicts in priorities 
will arise in proponents of the same philosophi- 
cal viewpoint. Educators may believe that both 
the fine arts and the three R’s are necessary 
elements of education, but one group may 
emphasize the former and another, the latter. 
A long and difficult process of goal setting can 
be expected. 

One of the chief dangers of goal setting is 
reductionism — emphasis on that which can be 
easily measured to the exclusion of the more 
abstract and complex (and often more impor- 
tant) objectives. Compromises are often made 
on short-range objectives, with the result that 



accountability stresses those objectives on 
which people can agree, like decoding skills 
in reading or basic arithmetic skills. When this 
occurs there is a tendency to spend more and 
more instructional time on the few basic skill 
areas in which objectives have been set. 
Humanities, fine arts, social sciences, and other 
subjects that are more value-laden and abstract 
in content are neglected. After all, the teacher 
knows that the objectives are not just for his 
students; his work will also be evaluated on 
whether his students have mastered those 
objectives which can be easily measured. 

Sometimes a kind of "reverse reductionism” 
is the final outcome of the struggle to define 
goals for the more abstract and value-laden 
areas. To avoid conflict, goals are framed in 
the broadest and vaguest manner, eliminating 
all controversies and allowing each educator 
to interpret the goals as he sees fit. For ex- 
ample, a number of State education agencies 
have set up commissions to establish broad 
goals. Typical products of these efforts are: 
"self-understanding,” "understanding others,’’ 
“interest in school and learning," "preparation 
for a changing world,” and so forth. These 
broad goals inhibit growth and movement by 
emphasizing that which is already established 
and digested by a culture. A society confronted 
by increasingly complex problems cannot rely 
on goals formulated decades ago. 

The emphasis on measurable student growth 
will bring to focus still another basic conflict: 
accountability can either be used to individ- 
ualize instruction, helping students learn more 
independently, or it can emphasize mastery, 
helping schools to do what they’ve always done, 
but with increased efficiency and fewer failures. 
Accountability forces educators to a cross- 
road; they can either reject the old factory for 
a more efficient factory (mastery learning), 
or reject the factory all together in favor of 
individualized learning. 

Accountable To Whom? 

Who is accountable to whom? The simplistic 
and idealistic answer is that everyone who has 
a role in the education of America’s youth is 
accountable. Everyone who is demanding 
accountability is also in some sense account- 
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able, if only to participate in goal setting and 
be held responsible for his contribution. The 
serious question of who should be accountable 
to whom, though, is a technical one which can 
only be answered after a thorough analysis of 
the system in question. Accountability must be 
related to the way in which the education 
system operates and the various parts inter- 
relate. There is no reason to hold a school 
administrator accountable for a particular kind 
of output if he does not have influence over 
that output. The system must be studied to 
determine who has impact on what process, 
or output, so that the appropriate persons or 
groups can be held accountable for their por- 
tion. But no specific part of the system 
I (teachers, for example) should be singled out as 

individuals to be punished. All parts of the 
system have to work harmoniously together. 

School boards must be accountable for their 
policies and for acting on the data provided 
by evaluators. Administrators must be account- 
able for the moral support and material re- 
sources they provide the classroom, for in- 
service teacher training, and for creativity in 
planning. Designers and developers of various 
kinds must be accountable for the curriculum, 
the school buildings, the equipment, and so 
forth. Teachers, teacher aides, and other per- 
sonnel must be accountable for the processes 
of diagnosis, instruction, and evaluation that 
I occur in the classroom, and for the specific 

■ behavioral objectives that they and the educa- 

tional community set. Parents must also be 
{ accountable for the physical and psychological 

support they give the school and for the learn- 
( ing situations and favorable psychological cli- 

i, mate they create in the home, for insuring that 

•; their children aren’t tardy and absent, and 

for attending school meetings. Even students 
^ should be accountable so long as the tasks for 

1' which they are held accountable are reason- 

1, able, well-designed, and adapted to their 

[ individual needs. 

f 

1 Resistances 

[ When accountability becomes a way to "pin 

I a rap’’ on a scapegoat for all of education’s 

[ problems, resistance naturally follows. In the 

long run it becomes a self-defeating political 
/' game. People will resist the changes required 

f. ' ' 
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by accountability just as man always resists 
change because he fears the unknown and 
because change is difficult work. If the fear of 
being fired, demoted, or fined is added to the 
fear of change, accountability in education will 
never occur. 

Already established institutions, like school 
boards and teachers' associations, feel threat- 
ened by accountability and have published 
statements against various accountability pro- 
posals and efforts. For example, teachers are 
generally against average student performance- 
based teacher evaluation, thorough evaluation 
of student progress (referred to as overtesting), 
and invasion of education by industry because 
they have not accepted the mastery learning 
concept and they presume that their jobs are 
in jeopardy. Board members tend to fear Fed- 
eral control, and administrators fear publication 
of test results, claiming lack of sufficient re- 
sources to implement an accountability system. 
Some parents even fear accountability because 
they think their children will learn reading, 
writing, and arithmetic to the exclusion of 
modern science, good morals, and football. 
And, of course, students fear excessive testing. 
These groups must be reassured that account- 
ability is diagnostic and analytical rather than 
judgmental. And the way to reassure them is 
to build into any procedure for accountability 
a statement or structure that would guarantee 
protection from retribution for the individual 
participants. The purpose is not to single out 
individuals but to improve education, and the 
ultimate responsibility for achieving goals m.ust 
be divided among ail groups involved in the 
educational system. Accountability is not a 
threat to professional freedom, but one of the 
bases upon which professional responsibility is 
built. All subelements of the system must share 
in the accountability effort, necessarily restrict- 
ing certain individual choices but increasing 
the efficiency and effectiveness of the whole 
system. If those to be affected by the system 
have some voice in its establishment and have 
the ability to influence the direction it takes, 
then there is less conflict between account- 
ability, personal freedom, and professional 
prerogatives. 

Teacher performance must be evaluated on 
individual teacher and student improvement 
rather than on absolute or normative standards 

10 
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if resistance is to be reduced and the teaching 
process perfected, it is not clear that it is 
necessary to use the "carrot and stick" to get 
professional people to do their job. Many 
teachers respond positively to informational 
kinds of reinforcement, such as the reward 
of knowing that students are progressing, that 
can be provided in an accountability system. 
Many educators fear that accountability will 
not foster maximum levels of achievement on 
the part of teachers and students. However if 
average standards are set for them, the setting 
of flexible behavioral objectives and the em- 
phasis on self-competition and individual 
change scores should help to overcome/the 
temptation to "just get by." But maximum levels 
of achievement must still come from an individ- 
ual's internal motivation, though the teacher 
should be given full recognition and reinforce- 
ment for maximum effort and superior achieve- 
ment. 

Teacher resistances to accountability can be 
further decreased when teachers can acquire 
more political power, greater self-governance, 
and a larger role in the development of the 
goals and objectives of the educational system. 
External mandates and legislation do not work 
well; they foster a we-they dichotomy. Laws 
that require a foreign language, special cur- 
riculum selection, or sex education to be taught 
have become political issues rather than pro- 
fessional questions. Inservice and preservice 
seminars on accountability might also increase 
its acceptance by school staff and administra- 
tors. But most importantly, such tactics as 
firing, allocating tough teaching assignments, 
bad classrooms, problem students, study hall 
duty, public embarrassment, and informal 
ostracism should never be associated with 
accountability. Accouiitability must be seen as 
a means, not an end. 

Another type of resistance results from the 
overselling of such approaches as performance 
contract, PPBS, and systems analysis. Often 
the advocates of such programs promise that 



they will solve all the problems facing a school 
district, and they gloss over the difficulties and 
complexities of implementation. On occasion 
the programs are poorly designed, hastily in- 
troduced, and finally rejected because they 
are not only incapable of delivering promised 
results, but have unforeseen, troublesome side 
' effects. Eventually, this is a self-eliminating 
problem because those advocates, contractors, 
and approaches which are not well founded 
will lose support. The danger is that they will 
discredit the whole movement along with them- 
selves. The only way to reduce this danger is 
to increase the clients’ professional judgment 
and competence. Perhaps accountability will 
promote competence at every level by holding 
people responsible for what they say and what 
they produce. 

J 

Iti Conclusion 

This survey of the philosophical phases and 
unresolved problems of the accountability 
movement has been necessarily brief and frag- 
mentary. Its purpose is to provide a vantage 
point from which to view the movement in 
perspective. The broad picture which emerges 
is that of an evolutionary development (a quiet 
revolution for those of more radical taste) pro- 
gressing towaro increased responsibility to 
each child in the care of the schools. The 
movement is full of contradictions, the same 
conflicts of values and priorities which face 
our society and all its institutions, and which 
make life in a democracy so frustrating and 
interesting. Many pitfalls have been pointed 
out; others exist; and all of them have the 
potential of retarding or derailing the promise 
of accountability. But the movement is basi- 
cally optimistic in spirit, affirming the capacity 
of all children to learn and the competence 
and commitment of educators to help them 
succeed. This spirit of optimism makes one 
hope it will prevail. 
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ACCOUNTABILITY AS A SYSTEM 



Input, transformation, output, and feedback 
are the four major functions of any system, be 
it a hummingbird looking for nectar flowers, 
a star holding its satellite planets in orbit, or 
a school district practicing accountability. As 



these functions operate over time, they enable 
the system to more closely approach its goals. 
Figure 1 is the classical system diagram; it 
illustrates the relationships between functions. 



Environment 



Input Transformation Output 



Feedback 



Figure 1. Classical system diagram 



Implicit in the concept of systems is pur- 
pose; a system moves toward goals (repre- 
sented by the output arrow) by transforming 
input (raw materials) into output. If the output 
produced by the system has all of the qualities 
that were desired and planned for, the system 
is achieving its goals. But often the goals 
describe an unattainable ideal state, resulting 
in a discrepancy between the real output and 
the goals. Such discrepancies are discovered 
through evaluation. Information about the dis- 
crepancy is fed back into the system through 
the feedback loop (dotted line), where it is 
used to make compensatory adjustments in the 
transformation process so that the new output 
can more closely approach the ideal state 
(goals). 

A heating system composed of a heater and 
a thermostat provides a very simple and con- 



crete example of these processes. The thermo- 
stat is set at 72°; the goal is maintenance of 
that temperature. The inputs (raw materials) 
to be processed by the system are air from 
the environment and energy in the form of 
fuel. The temperature of the air is evaluated by 
the thermostat which finds it too cold. This 
information is transmitted through the feed- 
back loop (wiring, in this case) to the heater 
which makes an adjustment by turning itself 
on. A heating transformation takes place, and 
the output is changed as warmer air is poured 
into the room. The thermostat continues to 
evaluate the changing air temperature until 
it reaches the goal of 72°, at which point it 
transmits a new message through the feed- 
back loop, causing the heater to adjust its 
transformation process again by shutting off 
the heat. Of course the heating system is not 
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